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USER INTERFACE FOR "HOW TO USE" APPLICATION 
OF AUTOMATED SELF SERVICE CALL CENTER 

TECHNICAL FIELD OF THE INVENTION 

This invention relates automated speech recognition 
(ASR) interfaces for self-service call center systems, 
and more particularly for an interface for caller's 
seeking "how to use" information. 
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BACKGROUND OF THE INVENTION 

Customer call centers are increasingly using 
automated self-service systems, which use voice 
recognition and interactive voice response techniques. 
5 Automated self-service systems are much less expensive 
than those using live service agents. A well designed 
self-service system can cost as little as 10% as a call 
center that uses live agents. 

One type of call center service that requires unique 

10 dialog and interaction is assistance to customers who 
desire to learn how to use products or services. The 
needs of a customer who is unsure how to use a product or 
service tend to be more difficult to define than for 
other services, such as providing sales or account 

15 information. For such customers, the flow of a self 
service dialog is complicated to design. 
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BRIEF DESCRIPTION OF THE DRAWINGS 

A more complete understanding of the present 
embodiments and advantages thereof may be acquired by 
referring to the following description taken in 
5 conjunction with the accompanying drawings, in which like 
reference numbers indicate like features, and wherein: 

FIGURES 1A and IB illustrate a "how to use" dialog 
in accordance with the invention. 

FIGURE 2 illustrates a computer implemented system 
10 for implementing the dialog of FIGURES 1A and IB. 

FIGURE 3 illustrates the timeout and retry 
processes . 
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DETAILED DESCRIPTION OF THE INVENTION 

The following invention is directed to a "how to 
use" interface for an automated self service customer 
call system. For purposes of example, this description 
5 is written in terms of a "how to use" interface for 
telephone services, on behalf of a telephone service 
provider. However, the same concepts may be applied to a 
"how to use" interface for any type of product or 
service . 

10 FIGURES 1A and IB illustrate the flow of a "how to 

use" (HTU) dialog in accordance with the invention. A 
computer system for implementing the HTU dialog is 
described below in connection with FIGURE 2 . 

As explained below, the system provides a caller 

15 with an interactive self-service series of verbal 

prompts, voice recognition entry points, and messages, 
the combination of which provide the caller with the 
desired information about how to use a selected service. 
Once a caller has selected a service of interest, then a 

2 0 topic of interest, the system provides the appropriate 
instructions . 

As explained below in connection with FIGURE 2, the 
dialog of FIGURES 1A and IB is implemented using computer 
hardware, which is programmed in accordance with the 

25 process steps described below. The HTU system allows 
callers to easily access instructions for a variety of 
services or products within a single phone call by using 
speech input. The system uses a combination of natural 
language and directed dialog elements, allowing callers 

30 to retrieve instructions through several different paths. 
Specifically, callers can identify a topic of interest in 
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three ways: by saying the name of the service or 
product, by selecting the topic from a menu, or by 
verbally describing what the service or product does in 
the caller's own words. This approach is achieved by 
5 using both statistical language models and grammar-based 
recognition techniques . 

Although the dialog is especially useful for voice 
recognition of voice responses from the caller, it also 
recognizes keypad input. In some steps, keypad input is 

10 requested by prompting, such as "Enter 1 for...." or "Enter 
your area code and phone number". In general, each of 
the caller's responses described herein could be 
substituted with a keypad entry, and DTMF recognition 
used rather than voice recognition. 

15 Step 1000 is a Welcome state. It is a play-prompt 

state, and like the other play-prompt states described 
herein, it plays a waveform, or a series of waveforms, to 
the caller who hears the waveforms as a spoken message. 
As an example of a welcome play-prompt, the caller may 

20 hear, "Welcome to the How to Use Guide for your phone 
services" . 

Step 1020 is an Offer Spanish interaction dialog 
module. Like the other interaction states described 
herein, Step 1020 prompts the caller for input. 

25 Interaction states also handle default timeout and 

retries, and typically continue to a next state upon a 
successful voice recognition. 

An example of an Offer Spanish prompt is: "Para 
continuar en Espanol por favor oprima el uno" . If the 

30 caller enters "1", the input is recognized as a DTMF 

signal and the call is transferred to a Spanish version 
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of the dialog. After a pause, and if no DTMF signal is 
received, the dialog proceeds to Step 1025. 

Step 102 5 is a Get Phone Number interaction dialog 
module. Step 1025 typically follows Step 1020. An 
5 example of the message played in Step 1025 is: "I'll 

help you find out how to use any of the phone services we 
provide for our residential customers. To get started, 
I'll need your area code and home phone number. You can 
either say it or enter it." 

10 The caller then responds by speaking or entering a 

number. If a number is recognized, the caller is thanked 
and the dialog proceeds to Step 1050. If no number is 
recognized, various timeouts and retry messages are 
delivered, and upon failure of these, the dialog is 

15 exited. 

Step 1050 is a Get Service Name interaction dialog 
module, and typically follows Step 1025. It may also be 
entered from Step 1310, Step 2015, or Step 4000, 
explained below. 

20 When entering from Step 1025, an example of a 

message to the caller is: "Now, please tell me which 
phone service you'd like to find out about, [pause] To 
hear your choices, say list them" . 

Natural language techniques are used so that the 

25 caller may freely speak the names of services or describe 
them in natural language. If the caller responds by 
naming or describing a service, the dialog proceeds to 
Step 1200. If the caller responds by speaking "List 
them", the dialog proceeds to Step 1075. 

30 If the caller has entered Step 1050 from Step 2015 

or from Step 4000, the dialog speaks a message such as 
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"If you're finished hearing about phone services, say 
"I'm finished", [pause] Otherwise,...." If the caller 
speaks "I'm finished", the dialog proceeds to Step 5000, 
explained below. If the caller does not say "I'm 
5 finished", the dialog proceeds as when entering from Step 
1025 . 

Natural language techniques are also used to 
recognize when the caller has named an unsupported 
service. If the caller names an unsupported service, the 

10 dialog proceeds to Step 4000. Step 4000 is a process 
whereby the system recognizes a number of unsupported 
services. For example, if the caller speaks "discount 
packages", the system responds with a message such as: 
"I'm sorry. Right now, I don't have any information 

15 about discount packages. If you want more information 
about this topic, you'll need to speak with a 
representative who can help. Would you like me to 
transfer you now?". If the caller speaks "Yes", the 
caller is transferred. If the caller speaks "No", the 

20 caller returns to Step 1050, hears an appropriate 

message, and is given another opportunity to select a 
service . 

Step 1075 is a Get Category Name interactive dialog 
module, performed if the caller has requested a list in 

25 Step 1050. An example of a message that the caller hears 
is: "I have the services grouped into categories based 
on what each service does. I'll read the categories, and 
when you hear the one you want, just say it. Call 
Answering, Caller Identification, Call Forwarding, Call 

3 0 Screening, Three-way Calling, Automatic Dialing, 

Personalized Ring, Local Plus." The caller may then 
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speak the name of the service category, and the dialog 
proceeds to Step 1200. 

After the message of Step 1075, the caller is 
offered various retries and timeouts if there is no 
5 response or the response is not understood. Also, after 
a category name is spoken, the caller receives a 
confirmation message such as "Automatic dialing. Is that 
correct? 7 '' 

Step 1200 is a Disambiguation Check internal 

10 decision step. If the caller has selected a service 

category having more than one type of service, it may be 
necessary to ask an additional question to determine the 
specific service name. Step 1200 determines whether to 
continue with the call dialog or to first go to a 

15 disambiguation state. 

The disambiguation check of Step 12 00 depends on 
which service the caller has selected. Some categories 
have only one associated service, and need no 
disambiguation. For those services, the dialog proceeds 

20 to Step 1300. However, other categories have more than 
one associated service. In this case, the dialog 
proceeds to Step 1210. 

Step 1210 is a disambiguation process. For example, 
if the caller has selected the category of Automatic 

25 Dialing in Step 1050 or Step 1210, the caller might hear 
the following message: "There are four services that can 
automatically dial a number for you. Say "Auto Redial, 
Call Return, Speed Calling, Direct Reply, or say Help for 
a brief explanation of each". The caller's response is 

30 recognized as the selected service of interest. 
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Step 1300 is a Check Service Name internal decision 
step. This state determines which of the various 
services the caller has asked for in Step 1050 or Step 
1210, and links to a dialog module associated with that 
5 service. 

Step 1310 is playing the dialog module linked in 
Step 1300. Each dialog module has a message that briefly 
describes its associated service and lists topics 
associated with that service. 

10 For example, if the caller has selected the Call 

Notes service, the caller hears the following message: 
"Call Notes voicemail records a message from callers when 
your phone is busy or you don't answer the call. To pick 
a different service, say Start over, [pause] There is 

15 also a related service called Call Notes Plus, which adds 
a few additional features. To find out about that, say 
Call Notes Plus, [pause] I have several topics related 
to Call Notes — thirteen in fact. I'll start reading 
the first set of topics, and when your hear the one you 

2 0 want, just interrupt me and say it. [pause] Here are 

the first four topics. Setup, retrieve messages, change 
number of rings, change passcode, [pause] Was it one of 
these?" If the caller responds, with "Yes" or the topic 
name, the dialog proceeds to Step 2000. If the caller 

25 responds "No", the dialog continues with additional topic 
selections . 

As with other interactive steps, each of the dialog 
modules of Step 1310 provides the caller with various 
timeout and retry options, and with a confirmation 
30 message after a topic is selected. The caller may also 
be given an option to speak "Start over" and return to 
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Step 1050. During or after the playing of the dialog 
module, the caller may say "Repeat that" to have the 
topics of that dialog module repeated. 

Services having numerous topics may have their 
5 dialog module divided into parts, so that the caller may 
hear only a portion of the topics in each part of the 
dialog module. The example above, listing the first four 
topics for Call Notes is an example of such a service. 
The partitioning of the topics permits the dialog module 

10 to prompt for and receive the caller' s request to "start 
over" or "Repeat that." 

A feature of Steps 1050, 1075, and 1310 is that 
services and topics are presented to the caller in 
frequency order. That is, the most frequently requested 

15 services and topics are offered to the caller first. 

In Step 1310, one of the available topics may be a 
Pricing topic. Because pricing may depend on the 
caller's service location, if the caller selects the 
pricing topic, it is next determined whether the caller's 

20 phone number has been obtained in Step 1025. 

Step 1625 is performed if the caller has selected a 
Pricing topic, and if the caller's phone number has been 
entered and recognized. In Step 1625, a database is 
queried and appropriate pricing information is accessed 

25 and reported to the caller. The dialog then proceeds to 
Step 2010. 

Step 1600 is an interactive dialog module, performed 
if the caller has selected a Pricing topic and the 
caller's phone number has not been entered or recognized. 
30 In Step 1600, an example message to the caller is: "To 
get accurate pricing information, I'll need to transfer 
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you to an SBC representative who can help. Would you 
like me to transfer you now?" If the caller responds, 
"Yes", the call is transferred. If the caller responds 
"No", the dialog proceeds to Step 2015. If desired, Step 
5 1600 may include an additional message to request the 
caller's phone number, so that the dialog may then 
proceed to Step 1625. 

Step 2000 is a Get Information dialog module, 
performed after the caller responds with a topic in Step 

10 1310 and if the information is too lengthy to be played 
from a single dialog module. If the information is 
sufficiently short to be played in a single dialog 
module, the dialog proceeds directly to Step 2010. 

The dialog of Step 2000 first plays a preamble 

15 message that corresponds to the topic that was chosen. 
For example, the message might be: "I have some 
instructions about how to set up call notes". The next 
message provides the information to be provided to the 
caller for the selected topic. 

20 After the message of Step 2000 is played, there are 

two possible paths for the remaining dialog. If all 
information has been given, the dialog proceeds to Step 
2015. If the information is lengthy, it is split into 
more than one dialog module, and the dialog proceeds to 

25 Step 2005. 

Step 2005 is a What Next voice menu module. It is 
performed after the information of Step 2000 has been 
played to the caller. This step plays a message that 
gives the caller the option of rehearing the information 

30 given in Step 2000 or of going on. An example message 
is: "Say repeat that or go on". 
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As indicated above, Step 2 010 is a second Get 
Information dialog module, and plays either the second 
half of information topics presented in Step 2000 or the 
entire information for topics that are to be played in 
5 one piece. For playing the second half of a topic, Step 
2010 is performed after the caller has responded "Go on" 
after Step 2005. When Step 2010 is used to provide all 
information . 

As indicated in FIGURE IB, at any point during Step 
10 2000 or Step 2010, the caller may speak "Stop". This 
causes the dialog to branch to Step 2015. 

Step 2015 follows Step 2010 and is a second What 
Next voice menu module. If the caller has entered Step 
2015 from Step 2010 and has not said "Stop", the 
15 following message is played: "To hear that again, say 
Repeat That. Otherwise,....". This provides the caller 
with an opportunity to hear the information from Step 
2010 again. 

If the caller does not say "Repeat that", the dialog 
2 0 asks if the caller would like more information about the 
particular topic selected in Step 1310. If the caller 
says "Yes", the dialog returns to Step 1310. If the 
caller says "No", the dialog goes to Step 1050, and 
continues as explained above. 
25 Step 5000 is a voice menu step, performed when the 

caller says "I'm finished" during Step 1050. Step 5000 
plays a first survey question, such as: "Before you go, I 
just want to ask you two questions about your 
satisfaction with this service. First, did I give you 
30 the information you were looking for?" If the caller 

says "Yes", the dialog says "Great" and proceeds to Step 
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5025. If the caller says "No", the dialog proceeds to 
Step 5025. In either case, the response is recorded. 

Step 5025 is a voice menu step, performed after Step 
5000. Step 5025 plays a second survey question, such as: 
5 "And rating your experience using this system on a scale 
from 1 to 5 with 1 being very dissatisfied and 5 being 
very satisfied, what's my score?". The caller's response 
is recorded and the dialog goes to Step 9100. By 
analyzing the recorded results of Steps 5000 and 5010, 
10 the system can evaluate its effectiveness. 

Step 9100 is a goodbye message. A message is played 
such as: Thanks for calling us. Goodbye". The call is 
then ended. 

The various "Repeat That" messages described above 
15 provide the caller with controllable playback, such that 
the caller may control the pace with which instructions 
are presented. Also, the division of messages into 
dialog modules ensures that the caller is not faced with 
"too much information" at once, and is given adequate 
2 0 opportunity to go back to a previous step or rehear a 
message of the present step. Each dialog has its own 
associated timeouts and retries, so that the caller is 
continually apprised of his or her position in the 
dialog . 

25 Each of the above -described interactive dialog 

modules and voice menus includes a "Help" feature. At 
any time during that dialog module, the caller may say 
"Help". The dialog then plays a message as specified by 
that dialog module. The Help feature is particularly 

30 useful during Steps 1050, 1075, and 1310, to assist the 

caller in identifying a topic of interest when the caller 
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does not know the correct name of the service or product 
or when the caller wishes to browse topics. 

FIGURE 2 illustrates a computer system 100 for 
implementing the dialog interface of FIGURES 1A and IB. 
5 An IVR Self Service Host process 105 is the main process 
for the system. It controls and passes tasks to various 
subsystems, one of which is the HTU process 110 of the 
present invention. Process 110 is programmed to perform 
the dialog process described above in connection with 

10 FIGURES 1A and IB. A database 111 stores messages and 

instructions to be played to callers, as described above. 
A survey database 112 is used to store survey responses 
collected during the survey steps (Steps 5000 and 5025) . 

FIGURE 3 illustrates the various timeout and retries 

15 included in several of the steps described above. Any 
one of the various interactive dialog modules described 
above may include these timeouts and retries. 

As illustrated, after a prompt for a caller 
response, in Step 300, system 100 may or may not detect a 

20 response. If a response is detected, Step 310 is 
determining a confidence level, which may be high, 
medium, or low. 

High confidence responses are successful voice 
recognition and trigger an appropriate response by system 

25 100. Medium confidence responses are followed by a 

clarification message 320, which results in a successful 
recognition or at least one retry prompt. The message in 
the retry prompt depends on the associated dialog module, 
and is stored with other messages for that dialog module. 

3 0 A low confidence response is following by one or more 

retry messages 350. Retries are typically limited to two 
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attempts, and if no response is recognized after that, 
the caller is transferred to a live agent. 

If Step 300 results in no user input detected, 
system 100 plays one or more timeout prompts 360 and 365. 
5 The contents of the prompt depend on the particular 

dialog module. After a predetermined number of timeout 
prompts, the caller is transferred if there is no 
successful recognition . 

A further feature of system 100 is the use of global 

10 commands. During the interactive dialog modules, the 

caller may at anytime by transferred to a live agent by 
speaking words such as" "agent", "representative", or 
"operator". Also, the caller may return to Step 1050 by 
saying words such as: "start over" or "main menu". If 

15 the caller is in Step 1210, these words return the caller 
to Step 1075. And as stated above, the caller may at any 
time speak a word such as "Help", to which system 100 
responds with a help message associated with the dialog 
module the caller was in. 

20 
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